Musical Interaction with Hand Posture and Orientation: A Toolbox of Gestural Control Mechanisms
نویسندگان
چکیده
This paper presents a toolbox of gestural control mechanisms which are available when the input sensing apparatus is a pair of data gloves fitted with orientation sensors. The toolbox was developed in advance of a live music performance in which the mapping from gestural input to audio output was to be developed rapidly in collaboration with the performer. The paper begins with an introduction to the associated literature before introducing a range of continuous, discrete and combined control mechanisms, enabling a flexible range of mappings to be explored and modified easily. An application of the toolbox within a live music performance is then described with an evaluation of the system with ideas for future developments.
منابع مشابه
The integral Music controller: Introducing a Direct Emotional Interface to gestural control of sound synthesis
This paper describes the concept of the integral music controller (IMC), a controller that combines gestural interface with direct emotional control of a digital musical instrument. This new controller enables the performer to move smoothly between direct physical interaction with an acoustical musical instrument, and gestural/emotional control of the instrument’s physical model. The use of phy...
متن کاملHIGHLIGHTED TOPIC Neural Control of Movement Simultaneous control of hand displacements and rotations in orientation-matching experiments
Torres, Elizabeth B., and David Zipser. Simultaneous control of hand displacements and rotations in orientation-matching experiments. J Appl Physiol 96: 1978–1987, 2004. First published December 19, 2003; 10.1152/japplphysiol.00872.2003.—In reach-to-grasp movements, the interaction between the hand changes in position and those in orientation is poorly understood. A theoretical approach previou...
متن کاملMachine Learning of Musical Gestures
We present an overview of machine learning (ML) techniques and their application in interactive music and new digital instrument design. We first provide the non-specialist reader an introduction to two ML tasks, classification and regression, that are particularly relevant for gestural interaction. We then present a review of the literature in current NIME research that uses ML in musical gest...
متن کاملA Component Model of Gestural Primitive Throughput
This paper suggests that there is a need for formalizing a component model of gestural primitive throughput in music instrument design. The purpose of this model is to construct a coherent and meaningful interaction between performer and instrument. Such a model has been implicit in previous research for interactive performance systems. The model presented here distinguishes gestural primitives...
متن کاملTask-dependent viscoelasticity of human multijoint arm and its spatial characteristics for interaction with environments.
Human arm viscoelasticity is important in stabilizing posture, movement, and in interacting with objects. Viscoelastic spatial characteristics are usually indexed by the size, shape, and orientation of a hand stiffness ellipse. It is well known that arm posture is a dominant factor in determining the properties of the stiffness ellipse. However, it is still unclear how much joint stiffness can ...
متن کامل